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Abstract 

We derive the bias, variance, covariance, and mean square error of the standard lag windowed correl- 
ogram estimator both with and without sample mean removal for complex white noise with an arbitrary 
mean. We find that the arbitrary mean introduces lag dependent covariance between different lags of the 
correlogram estimates in spite of the lack of covariance in white noise for non-zeros lags. We provide a 
heuristic rule for when the sample mean should be, and when it should not be, removed if the true mean 
is not known. The sampling properties derived here are useful is assesing the general statistical perfor- 
mance of autocovariance and autocorrelation estimators in different parameter regimes. Alternatively, 
the sampling properties could be used as bounds on the detection of a weak signal in general white noise. 

1 Introduction 

The correlogram, an estimate of the autocorrelation function (ACF) of a time series, is one of the corner- 
stone analyses in the signal processing toolbox and therefore an understanding of its statistical errors for 
various random signals is of fundamental importance. Since the first published work 1 2 1 the sampling prop- 
erties of various ACF estimators for a wide variety of different processes have been investigated 
Yet it seems that one fundamental process has not draw full attention: general independent and identically 
distributed (IID) processes. In particular, IID processes introduce two novel aspects to the statistical errors 
of ACF estimators: a non-zero mean and non-analytic signals. 

In order to investigate these novel effects and in particular the non-zero mean in particular, we compare 
the standard correlogram estimator both with and without sample mean subtracted from the data samples. 
These two estimators are introduced in section lzTl and section l2~2l respectivelv. We conclude by discussing 
how to treat the mean of a process when estimating correlation. 

Our main finding is that an unknown mean introduces non-zero lag dependent covariance irrespective 
of whether the sample mean is removed or not. This is surprising seeing that white noise signals are not 
non-zero dependent. 



2 Lag windowed correlogram estimators 

In dealing with an uncertain mean when estimating the autocovariance of a give sequence of data there are 
two possible procedures: either one estimates the mean from the given data or the mean can be guessed 
in some way not based on the given data. These two procedures taken together with the subsequent cor- 
relogram computation can be seen as two different types of autocovariance estimators. That is, there are 
autocovariance estimators that include some sort of mean estimation and there correlograms that do not. 
In what follows we consider one version of each, namely, we consider the standard windowed correlogram 
and the standard windowed correlogram with sample mean removal. 
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2.1 Estimator without sample mean removal 



The classical correlogram does not involve any explicit mean estimation. Allowing for lag windowing, we 
define it for positive lags as 

N—l 

%'P]:=W[l]Xi z *W# + ']. Z = 0,1,2..JV-1, (1) 
fe=i 

where z[l], z[2], ...z[N] are possibly complex data samples, N is the number of data samples, W[l] is an 
arbitrary real valued lag weighting function, and z* denotes the complex conjugate of z. We use square 
brackets [•] to refer to a function of a discrete valued variable. 
There are two standard choices for W[Z]. If 

W[l] = Wu[l] := j^j (2) 

the estimators is called the traditional unbiased correlogram, while 

W[l] = W P [l] := i (3) 

is known as the asymptotically unbiased correlogram. The latter is exactly the Fourier transform of the 
periodogram. The negative lags of the correlogram are determined from the positive lags in Q through 

R^[l\ ■= (r^I-1})*, Z = -l,-2,...,-JV + l. (4) 

The correlogram R^$ can be interpreted as an estimator of either the autocovariance sequence (ACVS) 
or the autocorrelation sequence (ACS) of the discrete-time, complex-valued random variable sequence 
{Z[n]; n = ... - 2, -1,0, 1, 2...}. By the ACS of {Z[Z]}, we mean explicitly the function 

R zz [l] :=E{Z*[n]Z[n + l]} 

where E {•} represents the expectation operator and Z* denotes the complex conjugate of Z; and by the 
ACVS of {Z[n}}, we mean 

C ZZ [l] := Cov{(Z[n] - /x), (Z[n + 1} - /*)} = E{(Z[n] - fi)*(Z[n + 1} - »)} 

see 1 3 1 for details. Thus, the ACVS differs from ACS in that the mean fi has been removed from the data 
sequence. In other words, ACVS is equivalent to its ACS if the mean of the data sequence is zero. For 
continuously sampled processes, the ACS and ACVS are known as the autocorrelation function (ACF) and 
autocovariance function (ACVF) respectively. 

Note that R^, for a nonzero mean fi signal, can also be interpreted as an autocovariance estimate 
in which, based on other, separate information, an assumed mean fi g was subtracted from the data (or 
that fi g was assumed and nothing was done to the data) which actually had the mean /i t . In other 
words, /i = fi t — fig could be seen as the error in the assumed mean. If the mean fi of the sequence 
{z[n]} is known exactly the signal can be converted into a zero mean sequence {z'[rj]} := {z[n] — fi} 
by subtracting the mean. We distinguish this case of the estimator R%z [I] by replacing the (fi) index 
with (0), viz R%[1}. Thus we can summarize formally the relationship between the autocorrelation and 
autocovariance estimators mentioned above as 

R%[l]=C zz [l] 

which says that the estimator of the form ([0 is an ACVS estimator if the process has a zero mean. The 
sampling properties of this special case estimator, R^J [I], is well documented and goes back to 0. The 
sampling properties of R$ with nonzero fi however, is what will concern us subsequently. 
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2.2 Estimator with sample mean removal 

If we extend the standard correlogram introduced in the previous section to include the subtraction of the 
sample mean from data samples we get the ACVS estimator 

N-l 

C^[l]:=W{l}^2(z[k]-zr(z{k + l}-z), Z = 0,1,2..JV-1, (5) 

k=l 

where 

1 N 

k=l 

is the sample mean. The negative lags can be estimated through a formula analogous to @. 

There are alternatives to simply subtracting the sample mean as in Q when estimating the ACVS if 
the mean is not known, see e.g. |6). Here we will only consider Cjz as it is still commonly used and of 
fundamental importance. 

3 General complex higher-order white noise 

The correlograms will now be applied to higher-order complex white noise with arbitrary mean. We seek 
to derived the sampling properties of each correlogram up to second-order properties. As it turns out, we 
only need to consider moments of the process up to fourth order. Thus, for our purposes it suffices to define 
a test sequence e[-] with the following properties 



E{e[n}} = n (6) 

Cov {e'[n], e'[n + I}} = Cov{e>]*, e'[n + I}*} = a 2 S .t = C ee [l] (7) 

Cov{e'[n}*,e'[n + l]} = m 2 5 0}l = s 2 cxp(i8 2 )5 j (8) 

E {e'[n]V[n + l]e'[n + l'}} = k 3 S ,iS , p (9) 



Cov {e'[n]*e'[n + I], e'K] VK + I']} = K45 n ^5 0} i5 ,i> + cr 4 5„, n /£ M / + s 4 <W;,„^-U' (10) 

where e' := e — /j is the centralised version of the process, 5^ m is the Kronecker delta, /i is the mean, a 2 is 
the central variance, mi is the second central moment, K3 and K4 are the third and fourth order cumulants 
respectively and n, n', I and I' are all arbitrary integers. The quantity m,2 and s 2 is what we will call the 
quadratic variance and the quadratic variance amplitude respectively. These names reflect the fact that 
they are not hermitian in contrast with the ordinary variance a 2 . 

The first property implies that the process has an arbitrary mean. The second is that the autocovariance 
is zero except for the zero lag. The third property is the nonhermitian quadratic autocovariance of the pro- 
cess which usually is either zero or equal to the autocovariance. The fourth property is a third order lagged 
cumulant of the process. The last property basically implies that there is no covariance between different 
autocovariance lags. Fifth orders and above are not specified and so e[ ] could have higher order correlation. 
Thus e[-] is more general than IID processes yet is equivalent in fourth and lower order properties. See |7 1 
for definitions of higher order lagged cumulants of random processes. 

For reference, we have the following relations in special cases: for a purely real process (hence nonan- 
alytic), 

${e[n]} = s 2 = a 2 
where is the real part operator, while for an analytical process |3 sec. 13.2.3] 

e[-] is analytic s = 

and for zero mean complex circular Gaussian white noise 

Vfc, e[k] ~ AA{0, a} K4 = K3 = s = fi = 0, 
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i.e. only <r 2 is non-zero, while for nontrivial Poissonian real white noise 

Vfc, e[k] ~ Poi{A} => K4 = K3 = a 2 = \i = A, s = 0. 

4 Sampling properties of the estimators to second order 

We now present some of the sampling properties, namely the bias, the variance, the covariance, and the 
mean-square error (MSE) for the case of the general noise process e[-]. These quantities were derived 
employing the usual techniques of estimation theory [3 1 and assuming that the process has the properties 
given in the previous section. The details of the derivations are given in a companion paper |4|. 

4.1 Sampling properties of correlogram without sample mean removal 

The estimator RU*) was defined in Q. With respect to the e[-] process, its sampling properties to second 
order are as follows. The bias for all lags is found to be 

Bias =E{R^[l]}-R ee [l] = {{N - \l\)W[l] - l){a 2 S 0l + |^| 2 ) (11) 

This shows that the so called unbiased estimator, Wt/[Z], is in fact always unbiased even when the mean is 
not zero. All other W[l] will result biased estimators if the mean is not zero. 
The covariance/variance of R^' for any two lags I and V of the same sign is 

Cov {%>[?],%>[?']} = W[l]W[V] (6 Ql S m ,( K4 + s 4 )N + 26 Ql n{fi K * 3 }(N- \l'\)+ 

+ 25 0l M{»K* 3 }{N - \l\) + 5 w ct\N - \l\) + 2| M |V (N - max(|Z|, \l'\)) 
+2$t{fi 2 m*}{N - mm(\l\ + \l'\,N))) , IV > (12) 

and when the lags have different signs the covariance is 

Cov {%>[/], %>[/']} =W[l]W[V] (6oi5 i>(K4 + <T' i )N + 25 ol n{nK* 3 }(N-\V\) + 

+ 26 w St{vu%}(N - \l\) + 5- ltl ,s*(N - \l\) + 2\p\ 2 u 2 (N - max(\l\, \V\)) 
+2ft{fi 2 m 2 }{N - mm{\l\ + \V\,N))) , W < (13) 

These expressions can broken down into all combinations of covariances and variances for zero lags and 
nonzero lags. The terms without 6 factors are the covariance of the nonzero lags of the estimator. They are 
zero if the mean is zero but otherwise they are non-zero and have a piece-wise linear dependence on the 
lags before applying the weight functions W[i]W[Z']. The 5w term plus the terms without 5 for I = V 7^ 
constitute the variance of the nonzero lags. This is nonzero and linear in lag before weighting even when 
the mean is zero. The terms with single 5oz or 8qi> factors plus the terms without 5 evaluated at either 
I = or V = 0, are the covariance between zero lag and non-zero lags. These are nonzero if the odd order 
moments fi and n 3 are nonzero. Finally, the terms with the <5oz<5oz' factor plus all other terms evaluated 
at I = V = is the variance of zero lag. It depends on all the moments. An example of the covariance 
structure is shown in figure^), ]^p), andQJ). 

The bias and the variance given above can be combined to give the mean-square error for the zero lag 
and the nonzero lag respectively 

MSE {i?^ } [0]} = («4 + s 4 + m{(j,K* 3 } + 25R{^ 2 m*} + l^N + o 2 {o 2 + 2|pt| 2 )(7V + 1))NW 2 [0} + 
- 2N{a 2 + M 2 ) 2 W[0] + (a 2 + \n\ 2 ) 2 (14) 
MSE {%)[/ ^ 0]} = (a 2 (a 2 + 2| M | 2 ) (JV - \l\) + 2^ 2 m* 2 }(N - min(2|Z|, N)) + |/x| 4 (iV - \l\) 2 ) W 2 [l} + 
-2\^(N-\l\)W[l} + \^ (15) 
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These expressions are exact for all sample sizes N. Asymptotically, that is as N — > oo, the MSE behave, 
assuming fi ^ 0, as 

MSe{/?^[0]} = (|/i| 2 4V) 2 (A 2 W 2 [0]-2AW[0] + l), N > 1, /* ^ (16) 
MSE {rW[1 ^ 0]} = H 4 ((AT - |Z|) 2 >V 2 [Z] - 2(A - \l\)W[l] + l) , A > 1, M ^ (17) 

where we have kept only the leading terms in A and I for each power of W[l]. 

From the asymptotic expression, we see that for the unbiased lag weights Wu [I] the leading terms in 
the MSE are zero. The asymptotic MSE for the nonzero lags in this case is 

MSE {m * 0]} = + % ' 2) + iN - ™ m > N)) , W^Wu,N»l. (18) 

While for the periodogram weighting Wp [I], the asymptotic MSE is \fi\ 4 l 2 /N 2 which does not tend to zero 
for large lags and so it is not a consistent estimator. 

This is in contrast to the well known case of zero mean. If [i = then the asymptotic MSE of the 
nonzero lags is instead cr (N — | Z | ) W 2 [Z] for all N as expected. The MSE of the unbiased estimator in this 
case tends asymptotically to <j a /(N —\l\) and so it does not converge for large lags, while the MSE for the 
periodogram estimator tends to er 4 (l — \l\/N)/N which tends to zero for large lags. It is for this reason 
that the periodogram weighting function Wp[Z] is preferred instead of the unbiased weighting Wj/[Z]. 

For the special case of zero mean see also |2). 



4.2 Sampling properties of correlogram with sample mean removal 

The sampling properties of the correlogram estimatorC^, defined in Q, for the noise process e[ ] were 
found to be as follows. 
The bias is 

Bias^Z]} = a 2 (W[0] - 1)Joj ~ (iV -; W] ) • (19) 

From this expression we find, remarkably, that all nonzero lags are biased irrespective of the choice of 
weights. For instance, the weights Wt/[/] known as unbiased in relation to the zero-mean correlogram 
R(°>, lead to a bias of —<j 2 /N for all lags. It is however possible to get an unbiased estimate for the zero 
lag if one chooses W[0] = 1/(N — 1). For this choice, the zero lag of is equivalent to the usual 
sample variance. 

The covariance/variance of C^> between any two lags I and /' of the same sign is 



Cov 



{C^[l],d^[l'}] = W[l]W[l'] (<W<V(«4 + s 4 )A- 



5o,im I 1 - 5 )~ 8o,i'K4 ( 1 - S ) + 5i, v <j\N - \l\)+ 



N J \ N 

Ki / _ 2max(|Z|, \V\) + 2min(|Z| + \V\,N) - 3(|Z| + |Z'|) _ IV_ 
N V N N 2 



a 4 [l- 



2max(|i|,|Z'|)-|*|-|* / | _ IV_ 
N N 2 



-s 4 



2min(|Z| + \l'\,N) - \l\ - IZ'I IV , . 
1 1 l N ' " '' - ^2 ) ) , « > (20) 
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and for lags of different signs 

Cov{dg>[t\,Cg>[l']} = W[l]W*[l'} (SojSo^i^ + a^N- 



S ,iK4 (l-^Pj- * ,i'«4 f 1 - §) + S \i\M'\ 8 *( N - 1*1)+ 

«4 / 2max(|Z|, \l>\) + 2mm(\l\ + \l'\,N) - 3(\l\ + \l'\) _ \W\ 
N \ N N 2 



■s 4 I 1 - 



2m & x(\l\,\l'\)-\l\-\l'\ \W\ 
N N 2 

_ g 4^ 1 _2nun(|Z| + y)-|^|-in_m^ > < 0. (21) 

Again, this expression unifies all combinations of variances and covariances between zero and nonzero 
lags; see the discussion in the previous subsection. The main differences with that of the estimator without 
mean removal is that in this case there is no dependence on the odd order moments /i and K3, and further, 
that the lag dependence before applying the weighting functions factor is quadratic in lag. An example of 
the covariance matrix is shown in figure[Qi),[5), and^f). 

The MSE of the estimator can be determined for the expressions for the bias and covariance given 
above. The result is 

MSE {C e ( f } [0]} = (a 4 {N - l)N + (k 4 + s 4 )N - s 4 - 2k 4 + ^) W 2 [0] - 2(A^ - l)a 4 W[0] + a 4 

(22) 

2|/|+2min(2|Z|,iV)-6|Z| P 



MSE {SSPt + 0]} . (><iV - | iD (l - 2|L) + |(l - 'l'l + '-™W.">-'l'l _ 3 ^ 

.^.. jggaj .f^ (23) 

The MSE in the asymptotic case is 

MSE |C £ ( f } [0] } = a 4 (N 2 W 2 [0] - 2iVW[0] + l) , > 1 (24) 

MSE{c , e ( f ) [/ ^ 0]} =<r A {N- \l\)W 2 [l], A^>1 (25) 

where we have kept only the leading terms in or / for each coefficient of W[l]. For the weighting 
sequence Wu[l], the MSE tends to zero as a 4 /(N - |Z|); while for Wp[l], the MSE tends to zero as 
cr 4 (l — \l\/N)/N. So both weight sequences lead to consistent estimators. However, the asymptotic MSE 
in both cases is different for different lags. 

For the special case of real valued processes see 0. 



5 Comparison of the correlograms with and without sample mean 
removal 

Now that we have the second order sampling of the correlograms with and without sample mean removal 
we can compare them. Examples of the covariance of the estimators are shown in figure^for various kinds 
of white noise both with and without zero means; and a comparison of the MSEs is shown in figure|2]for a 
zero mean noise process. 

Inspection of the sampling properties derived here reveals some novel features. One such feature is that 
the estimators nominally have nonzero covariance, that is, the estimates at different lags are not indepen- 
dent. This is down to the fact that the same data samples are reused in the evaluation of different lags of the 
correlogram leading to a relationship between lag estimates. More surprising is the fact that the variance 
of both the estimators are nominally lag dependent. This is despite the fact that the test sequence e is white 
and hence has no nonzero lag dependence, see Q. Also the covariance is lag dependent. 
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Figure 1: Covariance and variance between any two lags I and I' of the correlogram estimator (N =11) 
with and without sample mean removal for various types of white noise signals. The first column of panels, 
namely a), b) and c), are the correlogram without sample mean removal, w-^ [I], defined in equation Q; 
while the second column of panels, namely d), e) and f), are the correlogram with sample mean removal, 
[I], defined in equation (|5}- The signal in the first row of panels, namely a) and d) is analytic Gaussian 
white noise a 2 = 1; the second row, b) and e), is real Gaussian white noise; the third row, c) and f), is real 
Poissonian white noise with fj, = 1. In all plots, the variance is along the I = I' diagonal while the rest, 
I 7^ /' is strictly covariance. Note that the gray-scale in the second column is different from the linear scale 
of the first column in order to enhance the structure of the covariance. 
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Figure 2: Comparison of the MSE of the i?(°'and C^'estimators with Wp[Z] weights for the case of 
analytic Gaussian white noise with a 1 = 1, For all lags, the autocovariance sequence estimator using the 
sample mean, i.e. (^^represented by circles, exhibits a smaller MSE than the estimator using the known 
mean, i.e. represented by stars. 
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5.1 i? (0) and as autocovariance estimators when mean is known 



In the preceding sections we have assumed that the mean of the data sequence we are trying to estimate the 
autocovariance of is unknown. What can be said if the mean is known? It would seem natural that if we 
knew the mean we would subtract it from the data samples and use the estimator Ry 3 ' . Thus we would not 
use the estimator C^' as it involves estimation of the mean which we already know. Surprisingly however, 
inspection of the sampling properties presented here show that this choice of estimators is not immediately 
obvious. 

The MSE of the estimator is, in fact, smaller than that of the estimator for general white 
noise, assuming the same lag window is used in both estimators. The difference in the MSE is 

^^(^-OW'H (26) 

and is plotted in Figure [2] This difference tends asymptotically to zero as N is increased, but for finite 
sample sizes the is always better than the R(°> in the MSE sense. This is counter-intuitive as it seems 
to violate the principle that the more one knows about something, the better one can estimate it. 

The solution to this conundrum is that although the error in the covariance estimate is smaller, the error 
in the estimate of the mean is on the other hand larger. Specifically the difference in the MSE in the mean 
estimate is a /N . If take, e.g., the weights Wp [I] and use the inequality I < N then the MSE for lag I must 
be smaller than 2a 4 l/N 3 and so the total MSE of the estimator is of the order a A /N . This is comparable 
to the MSE in the sample mean. Thus the total error, autocovariance and mean estimation, is not better for 
the compared with _R (0) . 

Furthermore has a nonzero covariance between its lag estimates which i?(°)does not have. This 
can be understood from the following observation: that the sum over all non-negative lags of the estimator 
R(v) with periodogram weighting is equal to sample size times the square of the sample mean, i.e. 



N-l , N-lN-l 



N ■ 

1=0 1=0 k=l 



N-l 



fe=i 



= N\z\ 2 



^( p) 

for any process {z[fc]}. See |8| for further discussions. This shows that R zz and the sample mean z are 
related. But since is based on i?£* and z enters into every lag estimate, this suggests that there is an 
interdependence between lags and explain the nonzero covariance of the lags. 



5.2 When to use the sample mean if the mean is assumed small 

Let us now look at the situation when we believe that the mean is small. The question is which estimator is 
better: the one without or the one with sample mean removal. If we use the former we run the risk that the 
error in the estimated mean is large than the true mean. On the other hand, the mean may not be exactly 
zero so the latter estimate will also be off. There is a trade off here and we wish to find a criterion for when 
the sample mean should be removed. 

Inspection of the results presented earlier suggest that as a rule of thumb the two estimators are roughly 
equal when 

iMl = -4= (27) 



and when < a/V2N , is preferable to C M and when \fi\ > cr/V2iV, C M is preferable to R^. 
This condition can be understood in an intuitive way as follows. The sample mean is an estimate of the 
population mean with a relative error of (a/\/N)/\[j,\. It makes sense to use this estimate in the correlogram 
instead of the unknown mean only if this relative error is smaller than 1, i.e. when \fj,\ > a j\/2N . This 
is because the absolute error if we do not remove anything is of course only Thus we arrive at the 
condition as the found above j27l >. 

Naturally, if we do not know the mean we will not be able asses the equality J27l > exactly, but one could 
instead get it approximately by using the sample mean and the sample variance of the given data samples. 
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6 Conclusion 



We have presented expressions for the bias, variance, covariance, mean-square error of the classical correl- 
ogram estimator with and without sample mean estimation for general complex white noise with arbitrary 
mean. A summary of the sampling properties of the estimators for e[-], i.e., complex higher order white 
noise with arbitrary mean is as follows. The second-order sampling properties of the correlogram without 
sample mean removal, are in summary: 

• e[-] moment dependence: cumulants up to fourth order {p,, a 2 , s 2 , k 3 , k 4 } 

• Bias: unbiased for l/(N — I) weighting, even when fi ^ 

• Covariance: piecewise linear lag dependent covariance before weighting 

• Mean square error: is asymptotically proportional to |^| 4 when fi ^ while if fi = the MSE is 
asymptotically equal to a 4 (N - |/|)W 2 [Z] 

For the correlogram with sample mean removal, C^ p \ a summary of second-order sampling properties is: 

• e[-] moment dependence: only even order cumulants {a 2 , s 2 , n 4 } 

• Bias: nonzero lags biased for all weighting functions, zero lag unbiased for W[0] = 1/(N — 1) 

• Covariance: piecewise quadratic lag dependent covariance before weighting 

• Mean square error: asymptotically equal to a 4 (N — |Z | )>V 2 [Z] 

In terms of the properties of the process, we have found that a nonzero mean can lead to covariance between 
lags of the correlogram, and that complex valued processes lift the degeneracy between positive and positive 
lags, (that is that the sampling properties of positive lags and negative lags are different), and distinguishes 
between analytic and non-analytic processes. 

For both estimators, the both the variance and the covariance are in general lag dependent. We con- 
clude therefore that neither nor with the standard lag weights Wu[l] and Wp[l] are optimal for 
estimating the autocorrelation/autocovariance of noise processes with an unknown mean. 

Finally, we found that the sampling properties suggest that one should always remove the mean if it is 
known apriori. If the mean is not known, the sample mean should be removed only when > a/\/2N, 
i.e. R { £ ] is preferable to C { £ ] if \p\ < a/y/2N. 
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